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The  laser  range  finder  for  a  mobile  robot  is  mounted  on  a  mast  from  which  a 
noisy  measurement  matrix  Is  generated.  This  range  matrix  has  a  grid  with 
azimuth  angles  as  its  abscissa  and  elevation  angles  as  Its  ordinates.  With 
these  noisy  measurements,  a  rapid  estimation  scheme  is  used  to  detect  the 
presence  of  horizontel  and  vertical  edges  on  a  terrain  by  processing  the  range 
data  successively  along  each  column  and  row  of  the  range  matrix.  Hany  points  In 
a  three-dimensional  space  are  generated  by  estimating  sudden  change  in  the  range 
and  range  slopes  using  detection  scheme  with  a  decision  tree.  The  rasult  of  the 
estimation  Is  a  collection  of  data  points  to  form  a  curve  in  space  that  belongs 
to  some  edge  of  an  obstacle  from  the  vantage  point  where *the  laser  range  finder 
la  located.  The  orthogonal  surface  slopes  of  an  obstacle  can  be  determined  from 
the  range  slopes  which  are  estimated  from  the  range  matrix.  The  segmentation  of 
range  data  on  the  basis  of  surface  slopes  provides  groups  of  connected  data 
points  that  belong  to  one  particular  face  of  soout  observed  obstacles.  The 
problem  <$Z  grouping  range  data  points  of  different  planar  surfaces  on  the  basis 
of  their  surface  slopes  becomes  an  application  of  clustering  analysis. 

A  data  clustering  and  surface  fitting  operation  must  be  performed  and  the 
location  of  edges  and  vertices  must  be  determlnad.  Objects  are  then  assembled 
from  these  surfaces,  edges,  and  vettlces.  There  are  no  a  priori  knowledge  of 
the  number  of  objects  In  the  workscene,  however.  It  Is  assumed  that  all  the 
objects  In  the  scene  can  be  approximated  viodeled  as  having  many  planar  surfaces. 
Limitations  of  a  sight  system  depend  on  the  form  of  Input  data  used.  Systems 
such  as  laser  range  finder  systems,  which  use  range  Information  directly,  cannot 
determine  edges  between  objects  which  are  In  close  alignment.  Clearly  none  of 
these  Input  data  styles  can  determine  the  scene  description  perfectly; 
therefore,  any  object  recognition  scheme  would  strive  for  consistency. 

The  first  approach  of  a  heuristic  scheme  for  object  reconstruction  and  formation 
Is  presented  here  based  on  Input  data  containing  depth  Information.  This  scheme 
will  reconstruct  plane  faceted  objects  from  a  workscene  described  as  edges, 
faces,  and  vertices  In  cartesian  coordinates.  The  set  of  heuristic  rules  Is 
based  on  geometric  considerations  and  Insight  Into  the  characteristics  of 
objects,  which  are  found  to  be  the  convexity  and  coUnearlty  of  edges.  Methods 
for  determining  If  an  edge  Is  convex  or  concave  and  If  two  edges  are  collnear 
are  developed.  'Ihese  methods  are  consistent,  regardless  of  the  viewer's  point 
of  observation.  If  parts  of  the  image  of  the  workscene  In  the  Input  Information 
e:dilblt  certain  properties,  then  these  parts  will  be  grouped  as  ah  object. 
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INTRODUCTION 


There  are  many  drawbacks  of  U3in3  two-dic-.an3ional  imasas  for  a  'chree- 
dlmenslonal  description  of  the  scenes,  the  notable  ones  being:  the  absence  of 
depih  information,  and  strong  vulnerability  to  disturbing  influences  of 
ambient  lighting  which  may  causa  serious  errors  in  the  final  interpretation  of 
the  images  (refs  1,2).  To  afford  a  three-dimensional  interpretation  of  a 
scene  from  its  plane  image,  the  idea  of  using  multiple  Images  from  different 
vantage  points  has  been  utilized.  Tlie  stereo  T.V.  technique  (ref  3),  thus 
tries  to  obtain  depth  measurements  of  the  scene  directly  by  computation  from 
a  knowledge  of  the  camera  viewing  geometries.  To  enable  this,  a  correspon¬ 
dence  must  be  first  established  between  the  images  of  a  point  obtained  by 
different  sensors.  Much  computational  complexity  is  associated  with  this 
correspondence  problem  and  even  then  the  solution  is  not  guaranteed.  In 
recent  years,  some  attempts  have  been  made  to  base  scene  analysis  on  depth 
Information  measured  directly  from  the  three-dimensional  scene.  Tnus,  this 
principle  has  been  utilized  by  Duda  and  coworkers  (refs  1,2),  to  extract 
important  features  like  planar  surfaces,  edges  of  solid  bodies,  etc.,  from  the 
range  information  meas ^red  with  a  laser  range  finder.  Hovjever,  the  particular 
feature  extraction  procedures  used  in  that  work,  although  being  simple,  have 


^D.  Nitzan,  A.  E.  Brain,  and  R.  0.  Ouda,  "The  Measurement  and  Use  of 
Registered  Reflectance  and  Range  Data  in  Scene  Analysis,"  Proc.  IDES.  Vol. 

65,  No.  2,  1973. 

2r.  0.  Duda,  D.  Nitzan,  and  P.  Barrett,  "Use  of  Range  and  Reflectance  to  Find 
Planar  Surface  Regions,  IEEE  Trans.  Pattern  Analysis  &  Machine  Intelligence 
Vol.  PAMI-l,  No.  3,  July  1979.  "  ’ 

Y.  Yaklmovsky  and  R.  Cunningham,  "A  System  for  Extracting  Three-Dimensional 
Measurements  Prom  a  Stereo  Pair  of  T.V.  Cameras,"  Computer  Graphics  and  Ima->e 
Processing,  7,  li78. 
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3c:-.3  li  :atlor.3.  llaialy,  tha  aasisaptiona  of  having  aurfacea  largely 
hori^^atal  or  vertical,  orthogonal  faceted  bodies,  and  very  little  curved 
surfaces  ray  not  be  vary  practical  in  the  usual  scenes.  Moreover,  the 
thresholding  technique  used  for  detecting  edges  of  objects  might  fail  to 
obtain  satisfactory  results  when  the  actual  changes  are  less  than  tha 
threshold  value.  Tne  system  described  in  this  report,  in  principle,  uses  a 
tiiia  of  flight  range  finder  to  obtain  range  measurements  of  the  workscene  by 
scanning  in  the  elevation  and  azimuthal  directions.  The  feature  extraction 
and  scene  description  procedures  have  been  studied  from  a  point  of  view  of 
their  utilization  for  navigation  of  mobile  robots. 

Previous  work  on  scane  analysis  has  created  a  common  body  of  knowledge 
which  will  be  used  in  this  report.  Huffman  (ref  4)  created  a  system  of  labels 
to  represent  different  types  o£  three-dimensional  edges  in  two-dimensional 
line  drawings.  In  this  coding  system,  next  to  an  edge  indicates  a  convex 
edge,  indicates  a  concave  edge,  and  an  arrow  indicates  an  outside  jump 
boundary.  Shapiro  (ref  5)  defined  a  virtual  vertex  as  a  .vertex  formed  by  an 
occulsion  rather  than  by  the  intersection  of  edges.  In  Figure  1,  vertices  A, 
B,  C,  D,  E,  and  F  ace  formed  by  the  occlusion.  These  vertices  are  therefore 
classified  as  virtual  vertices.  A  virtual  vertex  denotes  an  edge  which  is 
Incompletely  described  (the  actual  coordinates  of  an  endpoint  are  unknown). 

In  aU  of  the  figures  in  this  report,  a  real  vertex  will  be  denoted  by  •, 

'^D.  A,  Huffman,  ’‘Impossible  Objects  as  Nonsensa  Sentences,"  Machine 
Intelligence,  Edinburgh  University  Press,  Voi.  6,  1971,  pp.  295--323. 

R.  Shapira  and  H.  Freeman,  "A  Cyclic-Property  of  Bodies  With  Three-Face 
Vertices,"  IEEE  Trans.  Comp.,  C-26,  1977,  pp.  907-915. 


while  a  virtual  vertex  will  be  denoted  by  o.  In  a  paper  on  Cwo*-dlmenslonal 
scene  analysis  (ref  6) ,  Guzoan  used  heuristic  rules  to  decompose  a  line 
drawing  Into  objects.  These  heuristic  rules  were  based  on  the  types  of 
vertices  which  occur  In  a  line  drawing. 

THE  RANGE  FINDING  SYSTEM  OF  SCENE  ANALYSIS 

A  number  of  Important  advantages  were  noted  for  the  scene  analysis  system 
using  range  data  over  those  using  Intensity  Information  of  a  plane  Image.  The 
depth  Information  Is  directly  measured  from  the  scene  and  Is  not  extracted 
Indirectly  from  the  television  or  camera  pictures,  therefore,  It  Ic  more 
accurate.  The  procedure  to  calculate  range  from  multiple  T.V.  pictures 
requires  matching  of  corresponding  regions  In  different  pictures  and  involves 
lengthy  and  complex  calculations.  The  exact  location  and*  orientation  of  the 
various  objects  la  the  scene  analyzed  Is  calculated  with  respect  to  the  robot 
vehicle's  frame  of  reference,  which  can  then  plan  Its  sequence  of  operations. 
No  lighting  or  Illumination  Is  required  as  the  laser  rahge  finder  provides  its 
own  beam  to  Illuminate  the  scene.  Disturbing  and' Interfering  effects  of 
ambient  lighting  cuch  as  shadows,  reflections,  shading,  highlights,  etc.,  that 
seriously  Impair  the  reliability  of  scene  analysis  procedures  based  on 
Intensity,  have  no  effect  on  the  range  based  scene  analysis.  The  complete 
scheme  of  the  range<-f lading  system  of  scene  analysis  may  be  regarded  as 
consisting  of  two  major  sections,  the  data  acquisition  and  feature  extraction 
section  and  the  object  recognition/ position  and  orientation  determination 


^A.  Guzman,  "Decomposition  of  a  Visual  Scene  Into  Three-Dimensional  Bodies," 
AFIPS  Proc.  Fall  Joint  Computer  Conference,  Vol.  33,  1968,  pp.  291-304. 
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section.  The  scene  analysis  system  Is  Itemized  as  follows. 


A.  The  data  acquisition  and  feature  extraction  section. 

1.  Scanning  scheme. 

2.  Rapid  estimation  si Verne. 

3.  Gradient  estimation  scheme. 

4.  Segmentation  of  range  data  on  the  basis  of  surface  slopes. 

5.  Plane/surface  fitting  and  smoothing  algorithms. 

6.  Calculation  of  continuous  inner  edges  as  the  intersection  of 
surfaces. 

7.  Verification  of  calculated  edges  with  those  obtained  from 
rapid  estimation  scheme. 

B.  The  object  recognition/ position  and  orientation  cection. 

1.  Grouping  of  edges  and  surfaces  belonging  to  individual  objects 

2.  Estimation  of  the  laser  range  finder's  vantage  poln*-  for  an 
object. 

3.  Generation  of  modeled  objects  view  from  the  estimated  vantage 
point. 

4.  Matching  of  the  generated  view  with  the  measured  one  for  edges 
and  vertices. 

5.  More  accurate  matching  by  slight  variations  of  calculated 
vantage  point. 

6.  Recognition  of  object  and  determination  of  its  position  and 
orientation. 
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DATA  ACQUISITION  AND  FEATURE  EXTRACTION 


The  laser  range  finder  of  the  robotic  system  is  mounted  on  a  mast  which 
separates  It  sufficiently  from  the  main  body  of  the  mobile  robot,  eo  that  its 
field  of  view  Ij  not  obstructed*  There  are  threa  separate  coordinate  systems 
Involved  in  the  utole  process:  the  coordinate  system  of  the  laser  range 
finder  In  which  the  range  measurements  are  performed,  the  coordinate  system  of 
the  robot  vehicle  In  %dilch  the  various  control  tasks  are  defined  and  executed, 
and  finally,  the  coordinate  system  of  the  terrain  fur  the  purpose  of 
navigation. 

The  Scanning  Scheme 

A  spherical  coordinate  system  is  defined  for  the  laser  range  finder  in 
which  the  range  finder  Itself  Is  assumed  to  be  at  the  origin  of  coordinates 
and  Its  beam  can  define  a  cone  of  revolution,  by  rotating  about  the  mast  axis. 
The  scene  of  Interest  la  scanned  using  small  Increments  of  polar  angle  and 
azimjethal  angle.  The  range  data,  r.  Is  arranged  in  a  matrix  form  with  rows 
showing  variation  of  angle  0  and  columns  showing  variation  of  angle  S. 

Rapid  Estimation  Scheme  for  Edge  Detection 

The  rapid  estlmatlcn  scheme  (R.E.S.)  (ref  7),  detected  the  presence  of 
3-D  curved  edges  In  the  workscene  by  processing  the  range  data  successively 
along  each  column  and  row  of  the  range  matrix.  An  edge  was  detected  by  a 
sudden  change  in  the  range  and/or  range  slope  using  detection  scheme  with  a 
decision  tree.  The  result  of  R.S.S.  Is  a  collection  of  3— D  range  measurement 

^C.  S.  Kim,  R.  C.  Marynowskl,  and  C.  N.  Shen,  "Obstacle  Detection  Using 
Stablllzated  P.apld  Estimation  Scheme  with  Modified  Decision  Tree."  Proc.  o^ 
JACC,  October  1978. 


points  th&t  belong  to  some  curved  edge  of  an  object.  These  data  points  are 
widely  spaced,  depending  on  the  data  density  that  was  Imposed  on  the  scanning 
scheme  through  the  use  of  particular  values  of  Ag  and  A6. 

Slope  Estimation  Scheme 

Range  slopes  are  defined  as  the  Incremental  changes  in  rr.nge  for 
corresponding  Incremental  changes  ^n  the  pointing  angles,  i.e.,  racgc  inpath 
slope  -  (3r/30)  and  range  crosspath  slope  •  3r/36.  The  two'dimensioual 
smoothing  algorltlm  (ref  8)  provides  smoothed  estimates  of  range  and  range 
slopes  which  are  used  for  calculation  of  actual  terrain  surface  slopes* 
Segmentation  of  Range  Data  into  Plane  Surfaces 


Ideally,  a  plane  surface  of  an  ooject  has  constant  slope  along  any  two 

! 

fixed  ortiogonal  directions  throughout  its  extent.  Using*  this  idea,  the 
observed  data  points  of  plane  surfaces  are  grouped  into  various  subsets,  one 
for  each  surface,  on  the  basis  of  their  "surface  slopes."  These  "surface 
slopes"  are  defined  as  the  slopes  shown  by  the  surface  of  the  object  at  the 
data  points.  The  segmentation  of  range  data  on  the  basis*  of  surface  slopes 

I 

provid'"  •  groups  of  connected  data  points  that  belong  to  one  particular  face  of 
some  ob'^erved  object. 

i 

A  Clustering  Procedure  for  Extraction  of  Plane  Surfaces 


The  problem  of  grouping  range  data  points  of  different  plan*’*  surfaces  on 
the  basis  of  their  surface  slopes  becomes  an  application  of  clustering 


o 

C.  S.  Kim  and  C#  N.  Shen,  "A  Two-Dimensional  Recursive  Smoothing  Algorithm 
Using  Polynomial  Splines,"  IEEE  Int.  Symposium  on  Info.  Theory,  1980. 
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analysis  (ref  9,10),  in  which: 


L.  Tho  dlstlngulahlng  feature  vector  is  X  ■  (flif2l^»  where  f^  and  f2 
r.re  the  two  orthogonal  slopes  with  respect  to  orn  of  the  three  coordinate 
planes  of  the  laser  range  finder. 

2.  The  number  of  clusters  ’c*,  in  other  words,  the  number  of  plane 
surfaces  observed  in  the  scene,  is  not  known  initially. 

3.  An  initial  configuration  or  rough  classification  of  feature  vectors 
into  clusters  cannot  be  obtained  by  any  simple  procedure. 

4.  Feature  vectors  corresponding  to  parallel  plane  surfaces  have  to  be 
discriminated. 

Since  an  initial  partitioning  of  data  could  not  be  found  from  the  given 
problem  soecif ications,  agglomerativa  hierarchical  clustering  (ref  9)  was  used 
to  obtain  a  reasonable  initial  partitioning.  Moreover,  the  whole  data  set  is 
not  treated  at  one  time,  but  a  recursive  approach  is  adopted  to  cover  the 
complete  measurement  space.  Recursive  approach  was  necessary  for  reducing 
computation,  and  differentiating  between  feature  vectors  of  parallel  planes. 

To  make  the  classification  optimal,  the  familiar  sum  of  s(|uared  errors 
criterion  function  (refs  9,10)  is  minimized.  A  least  squares  plane  is  then 
fitted  to  each  of  the  clusters  to  describe  the  particular  face  of  some  object. 
The  edges  of  the  objects  can  then  be  calculated  as  the  Intersection  of  the 
i plane  faces, 
i 

! _ 

i 

A 

R«  0.  Duda  and  P.  E.  Hart,  Pattern  Classification  and  Scene  Analysis,  John 
I  Wiley  and  Sons,  New  Yortt,  197  3. 

J.  Fukunaga,  Statistical  Methods  of  Pattern  Recognition.  Academic  Press, 


i 
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OBJECT  RECONSTR-JCTION  AND  RECOGNITION 

Various  fedges  and  plane  surraccs  extracted  above  are  then  assembled  into 
meaningful  bodies  using  he>.uristic  rules  based  on  physical  constraints  of 
bodies.  The  strategy  adopted  for  object  Identification  Is  essentially  a  model 
based  recognition  process.  Three-dimensional  models  of  all  the  objects  likely 
to  be  present  in  the  workscene  are  first  stored  in  the  computer  memory  which 
consist  of  a  specification  of  the  lengths  and  spatial  position  of  all  the 
edges,  the  coordinates  of  all  the  vertices,  and  the  angles  between  their 
component  edges.  A  coordinate  system  is  then  fixed  in  the  model  and 
defined  with  respect  to  its  vertices  and  edges  observable  from  outside,  -.'he 
computer  memory  contains  many  stored  models  and  an  initial  guess  for  the 
identity  of  the  observed  object  is  based  on  the  lengths  of  the  observed  edges 
aud  Che  angles  between  them,  at  a  particular  vertex  or  face.  A  similar 
vertex  or  face  is  then  searched  in  the  model  library  and  a  list  of  candidate 
models  la  drawn.  The  viewing  geometry  of  the  laser  range  finder  is  then  given 
by  the  position  and  orientation  of  its  axes  with  respect  to  the  coordinate 
system  fixed  in  the  object. 

Assemb-V  Method 

A  useful  clue  in  tUa  grouping  of  surfaces  into  objects  is  the  convexity 
of  edges.  Surfaces  which  intersect  at  a  convex  edge  are  generally  part  of  the 
s^e  object.  This  fact  alone  successfully  groups  many  different  objects. 

An  occlusion  will  ap^lt  one  object  into  two  half-objects.  If  possible, 
these  half-objects  should  be  grouped  together.  The  half-edges  formed  by  the 
occlusion  will  end  in  virtual  vertices.  If  two  half— edges  were  part  of  the 
same  edge,  then  they  would  be  collnear.  Also,  the  half-faces  on  both  sides  of 
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the  occlusion  would  be  coplanar  if  they  were  part  of  the  saae  face. 

Using  this  information,  %  set  of  heuristic  rules  is  developed. 

Heuristic  Rules 

Planes  will  be  collected  into  the  same  object  If  they  satisfy  these 
rules: 

1.  Intersect  at  a  convex  edge. 

2.  Contain  collnear  half-edges  %)'hlch  have  adjacent  coplanar  faces. 

3.  Intersect  at  a  concave  edge  where  one  of  the  vertices  of  the  edge  Is 
on  the  outside  edge,  and  the  concave  edge  la  not  collnear  with  the  outside 
edge. 

These  heuristics  ate  plctorlally  described  In  Figure  2,  where 
indicates  that  the  two  faces  connected  are  grouped  Into  the  saae  object. 
Flgtire  2a  shows  faces  which  are  grouped  because  of  the  convex  edge  between 
them.  Figure  2b  shows  faces  which  are  grouped  because  they  contain  collnear 
edges  with  adjacent  coplanar  faces.  Figure  2c  shows  an  example  of  grouping 
according  to  Rule  3. 

Rule  3  Is  Included  In  the  set  of  rules  because  a  laser  range  finder, 
which  measures  only  depth,  will  not  see  an  edge  between  objects  which  are 
aligned.  In  Figure  3,  Fart  C  will  be  grouped  Into  the  aaln  body  when  vlewp.d 
from  the  right  because  It  contains  part  of  face  1,  and  face  1  has  convex  edges 
which  link  It  to  the  rest  of  the  aaln  body.  Face  1  contains  vertices  A,  B,  C, 
D,  E,  and  F.  If  this  object  Is  viewed  from  the  left,  we  want  the  saae  group¬ 
ing  to  occur  so  that  the  description  of  the  scene  will  be  consistent.  When 
viewed  from  the  left.  Part  C  can  be  grouped  into  the  main  body  by  Rule  3. 

Part  A  exhibits  the  saae  characteristic.  Part  B  Is  not  grouped  with  the  aaln 
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body  since  the  concave  edge  Is  collnear  with  the  outside  edge  of  the  main 
body. 

Using  the  real  world  as  an  example,  objects  on  a  table  are  considered 
separate  objects  unless  they  are  aligned  with  an  edge  of  the  table. 

Convexl ty 

One  of  the  most  Important  features  of  the  object  reconstruction  scheme  is 
determining  whether  or  not  an  edge  Is  convex  or  concave.  We  define  convexity 
as  follows: 

If  the  angle  between  two  Intersection  planes  which  goes 
through  the  object  and  Is  perpendicular  to  the  edge  of 
Intersection  Is  leas  than  180  degrees,  then  the  edge  of 
Intersection  Is  convex. 

To  determine  If  an  edge  is  convex  or  concave,  we  define  the  unit  normal 

A 

vector  and  L2  for  the  edge  In  both  planes  Intersecting  at  the  edge.  Figure 
4.  These  unit  normal  vectors  lie  In  the  planes  forming  the  edge,  are  perpen¬ 
dicular  to  the  edge,  and  point  to  the  Inside  of  the  plane.  Then  we  form  the 
unit  vector  pointing  from  the  range  finder  eye  to  the  midpoint  of  the  edge  In 

A 

question  and  call  this  vector  R.  If  the  dot  product  of  R  and  the  sum  of  L]^ 

A 

and  L2 

A  A 

R  •  (Li  +  L2)  (1) 

Is  greater  than  zero,  a  convex  edge  Is  Indicated.  |  If  this  dot  product  is  less 
than  zero,  a  concave  edge  Is  Indicated.  Examples  of  how  convexity  Is 
determined  are  shown  In  Figures  5  through  7,  where  R^  Is  the  projection  of  R 

i 

Into  the  plane  formed  by  Li  and  L2.  \ 

This  method  of  determining  con’-exity  Is  necessary  because  a  simpler 
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method  using  the  change  of  sign  of  the  gradient  cannot  differentiate  between 
the  convexity  of  Figure  6  and  the  concavity  of  Figure  7.  Only  Interior  edges 
are  checked  for  concavity.  Outside  edges  are  classified  as  jump  boundaries 
and  are  noted  as  being  convex. 


Collnearlty  and  Coplanarlt; 


All  half-edges  are  searched  to  see  If  any  pairs  are  collnear.  For  two 


half'-edges  to  be  collneer,  three  of  the  possible  six  unit  vectors  formed  by 


pairs  of  the  four  vertices  must  be  equal  (Figure  3).  itu  choose  to  use  the 
pairs  (A,B),  (A,C),  and  (A,D),  and  say  If: 


AB  AC  AD 

n^TT "  TTacTT  ’  TTadTI 


(2) 


then  the  half-edges  are  collnear.  If  the  close:;f.  pair  of  vertices  consists  of 
virtual  vertices,  such  as  B  and  C,  then  the  edges  are  candidates  for  being 
merged  together  Into  a  longer  edge.  However,  the  merging  Is  not  performed 
until  adjacent  coplanar  faces  sre  found. 

Due  to  noise  In  the  range  data,  the  edges  obtained  by  the  Intersection  of 
planes  will  not  be  exact.  Also,  we  would  Ilk  .  to  avoid  the  necessity  of 
ordering  the  vertices  before  cheeking  for  collnearlty.  For  this  reason,  the 
actual  test  for  collnearlty  will  be: 


AB«AC  ABWAD 

^  TTIiii  iiAcii  *  ^^TTIiTrTII^iT  ^ 


where  K  la  a  small  number  dependent  on  the  amount  of  noise. 

Half-faces  which  are  ccplanar  will  have  equal  unit  normal  vectors 
associated  with  the  collnear  half-edges.  However,  to  take  Into  account  the 
noise  in  the  Input  data,  the  actual  test  for  coplanarlty  of  faces  will  be: 
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IlLi  -  L2II  <  K2  (A) 

where  K2  la  another  coastant  based  on  measurement  noise. 

If  Rule  2  Is  satisfied,  then  the  half-edges  are  merged  and  the  adjacent 

A  A 

coplanar  half-faces  are  merged.  In  Figure  8,  Lj  -  Lo,  Indicating  that  the 
half-faces  are  coplanar.  Also,  Afi  Is  coll near  to  CD,  and  both  B  and  C  are 
virtual  vertices,  satisfying  Rule  2.  Hence,  F2  will  be  merged  with  FI  and  AB 
will  be  combined  with  CD  to  form  AD. 

Results 

Computer  simulation  was  performed  on  an  IBM  3033  computer  In  a  program 
written  In  LISP.  A  sample  workscene  Is  pictured  In  Figure  9,  where 

signifies  the  position  of  the  laser  range  finder  eye,  which  Is  the  origin  of 

* 

the  cartesian  coordinate  system  In  which  the  Input  data  Is  recorded. 

The  Input  Is  In  the  form  of  lists  of  features.  A  face  Is  defined  as  the 
list  of  edges  %>hlch  bound  It,  an  edge  Is  defined  as  a  pair  of  vertices  and 
contains  the  Information  on  the  unit  vectors,  and  a  vertex  is  defined  by  this 
list  of  Its  coordinates.  For  example,  face  FI  Is  defined  as  (EF  DF  CD  CE)  in 
the  sample  workscene.  Also,  edge  DF  is  defined  as  ((FI  0  -1  0) (72  0  0  1)) 
where  (0  —1  0)  la  the  direction  of  the  unit  normal  vector  associated  with  FI 
at  edge  DF.  Vertex  A  Is  defined  as  (—A  —20  12),  Its  coordinates  relative  to 
the  range  finder  eye  location.  Which  vertices  are  virtual  Is  de';ermlned  using 
the  fact  that  virtual  vertices  are  the  endpoints  of  only  one  edge,  while  other 
vertices  are  formed  by  the  Intersection  of  more  than  one  edge. 

The  Output  contains  the  description  of  the  scene  upon  completion  of  the 
object  reconstruction  scheme. 
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Tha  outDUt  was: 


VICTUAL  VEkTICSS: 

(I  S  T  M  a  Q) 

I'i  - .  i  j  D  u  3 : 

(UN  LO  A?) 

CONCAVE: 

jCCD  DU) 

CO'A/EX: 

(D?  KV  DO) 

C3JEGT1: 

(FI  F2  F3  F4) 

03JECT2: 

(F5  Fo) 

schema  actually  work 

ed  as  follows: 

o  Virtual  vurUices  were  found. 

3  Golinear  half-edges  were  fixed  creating  NE17EDGES  HN  BO  AP  and  merging 
faces  F7  and  F3  into  face  F3  and  F4,  respectively, 
o  FI  and  F2  were  linked  across  convex  edge  FD. 

o  F3  and  F4  were  linlced  across  convex  edge  BO. 

o  F5  and  F6  were  linked  across  convex  edge  KV. 

3  FI  and  F2  ware  both  linked  with  F3  based  on  Rule  3  at  edges  CD  and  DH. 

No  ocher  links  were  possible  so  Chat  the  group  of  faces  were  then 
conaidored  objects.  Note  that  F7  and  F8  do  not  appear  in  any  object  list 
since  they  have  been  merged  away. 

CONCLUSIONS 

A  system  for  analyzing  scenes  in  navigation  application  of  robot  vehicles 
has  been  described.  The  sensor  assumed  for  performing  measurements  on  the 
workscene  is  a  time  of  flight  range  finder.  Procedures  have  been  studied  for 
extracting  important  features  of  the  scene  like  edges  and  surfaces  of  the 
objects,  for  describing  individual  objects  by  their  edges,  vertices,  and 
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bounding  surfaces,  and  finally,  for  recognizing  the  previously  known  objects 
as  observed  in  the  scene  by  comparing  the  observed  features  with  those  of  a 
model  stored  in  the  system  memory.  It  is  expected  that  the  finally  developed 
system  will  be  able  to  recognize  known  objects  in  their  true  relative 
locations  with  respect  to  each  other  and  with  respect  to  the  robot.  The 
performance  of  the  system  will  not  be  affected  by  variability  in  position  and 
orientation  of  objects,  and  in  the  Illumination  conditions  of  the  workscenes. 

Heuristic  schemes  have  been  proposed  in  the  past  for  reconstruction  of 
two-dimensional  objects.  These  sets  of  rules  have  generally  depended  on  an 
exhaustive  list  of  the  types  of  vertices  that  appear  in  the  two-dimensional 
projection  of  the  wnrkscene.  The  type  of  heuristic  rules  used  for  two- 
dimensional  object  reconstruction  are  both  overly  lengthy  and  not  adaptable  to 
three-dimens loual  object  reconstruction. 

This  report  propose i  a  three-dimensional  object  reconstruction  scheme 
which  uses  heuristic  rules  based  solely  on  three-dimensional  geometric 
considerations.  We  found  that  given  three-dimensional  input  describing  a 
workscene,  the  objects  contained  in  the  scene  can  be  reconstructed  using  these 
hetirlstic  rules.  In  cases  where  enough  information  is  available,  parts  of  the 
scene  which  are  masked  by  occlusions  can  also  be  rebuilt.  The  reconstruction 
is  consistent  and  allows  for  error  due  to  measurement  noise. 

The  final  description  of  the  scene  could  be  utilized  in  a  complete  robot 
sight  system,  allowing  the  robot  to  scan  the  scene,  navigate  to  some  desired 
position,  and  perform  some  task.  A  robot  having  such  ability  would  be  useful 
in  places  where  it  is  undesirable,  for  environmental  reasons,  for  a  human  to 
go  and  where  remote  control  would  be  too  slow. 


14 


In  the  future,  the  sight  systeia  will  be  axpandad  by  linking  it  to  an 
object  Identification  6cheice«  Objects  found  in  the  workscene  will  be  compared 
with  previously  stored  tcodels  in  the  library.  This  library  will  contain 
information  on  all  objects  that  could  be  found  in  the  workscene.  Object 
identification  is  another  step  toward  providing  sight  for  a  robot.  Once  the 
objects  are  identified,  control  tasks  can  be  planned  end  executed. 
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Figure  6.  Obtuse  Convexity 
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Figure  7.  Obtuse  Concavity 
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